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The vocal input device is used for receiving a vocal input having at least one 
oiphonum e rio symbol logogram and converting the vocal input into a first signal. The 
handwriting device is used for receiving a handwriting input describing one featur e portion of the 
object alphonumorio symbol logogram, and converting the handwriting input into a second 
signal. A vocal similarity estimator is used for generating an olphanum e rio symbol lopopram 
array having a plurality of candidate alphanumeric symbols logograms corresponding to the 
object olphonimi e rio symbol logogram according to the first signal. A handwriting similarity 
estimator is used for extracting the most coincidental candidate alphanum e ric symbol logogram 
from the alphanum e ric symbol logogram array according to the second signal. The feature 
portion of the object alphanum e ric symbol logogram is the radical of the object alphanum e ric 
sviRbet logogram . 



Base Based on the above structure, the method of the present invention integrates vocal 
input recognition and handwriting input recognition comprising the steps of: First, receiving a 
syllabic vocal input signal of one object alphanimi e ric symbol logogram : Second, recognizing 
the input vocal signal and generating an alphanum e ric symbol logogram array having a plurality 
of candidate alphanumeric symbols logograms corresponding to the object alphanumeric symbol 
logogram^ then receiving an handwriting input signal describing the featur e portion of the object 




Please replace the final paragraph beginning on page/^ and ending on page 4 with the 



following: 
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olphonumcrio symbol logogram: finally, extracting the most coincidental candidate olphonumerio 
^«bel logogram from the alphanumeric symbol logogram array according to the leatwe 
portion , 

^ Please replace the first complete paragraph on page 4 with the following: 

Therefore, the present invention takes advantage of complement between vocal input and 
vocal input, especially by a complete vocal input of an alphanumerio symbol logojgram a part of 
handwriting input including radical structure. By this way, the present invention provides more 
sufficient information for characteristic recognition, and therefore promotes recognition rate 
effectively. 

^£^73^ 3 ol Please replace the first paragraph on page / with the following: 

Fig.4 is an illustration of a vocal database building up alphanum e ric symbol logogram 
array by the same pronunciation. 

M 'I'd 'i'Ol Please replace the second paragraph on page i with the following: 

Fig.5 is an illustration of tracing the radical of an object alphanumerio symbol logogram 
by handwriting input. 

\/^f 7' >i Please replace the third paragraph on page B with the following: 

Fig.6 is an illustration of tracing the substructure of an object alphanum e rio symbol 
logogram by handwriting input. 
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^ Please replace the fourth paragraph on page p with the following: 

Fig.7 is an illustration of tracing the radical of the other different object alphanumeric 
symbol logogram by handwriting input. 

^'dlr^ Please replace the fifth paragraph on page i with the following: 

Fig.8 is an illustration of tracing the radical of another difTerent object alphanum e rio 
symbol logogram by handwriting input. 

73-3*oi Please replace the sixth paragraph on page / with the following: 

Refer to Fig.l, in the preferred embodiment, the recognition system of the present 
invention integrates vocal input and handwriting input comprising a first input device 1, a second 
input device 2, a vocal pattern training device 3, a handwriting pattern training device 4, a first 
feerture portion extractor 5, a second fealufe portion exactor 6, a vocal-input similarity estimator 
7, and a handwriting-input similarity estimator 8. 

Please replace the first complete paragraph on page/ with the following: 

Wherein the second signal S2 is a substructure rather than a complete handwriting input 
of one alphanumerio symbol lopopram . Because the general handwriting input device is 
designed to provide user for inputting in a predetermined time span, if user does not continue 
handwriting inputting during the time span then the handwriting motion will be considered 
completed. Therefore the second signal S2 means a stroke inputted during a predetermined time 
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span. The stroke might be only a substructure, or a radical, or the overall of one alphonum e rio 
svfflbet logogram . 



Besides, the present invention further comprises a vocal database 30 and a handwriting 
database 40. The vocal database 30 stores a plurality of vocal patterns, associate Chinese 
vocabulary/phrases, and Chinese granunar rules, etc. For the convenience of processing the 
following recognition steps, the data of vocal database 30 is represented as Fig.4 (top-down 
[fon], [fon /], [fon V], [fon \]separately), determined by the same pronunciation and usage rate. 
In other word, each alphanum e ric symbol logogram array is constructed by many candidate 
alphanum e ric symboh logograms having the same pronunciation, and the position of the 
candidate alphonum e rio symbol logogram represent the usage rate, the position more left, the 
usage rate more frequent. On the other hand, the data of handwriting database is sorted by 
strokes of the object alphanum e ric symbol logogram and radical of the object alphontunerio 
symbel logogram . With respect to the method of building up associate database by radical or 
strokes of the alphanum e ric symbol logogram has been disclosed in the associate prior arts such 
asUSPatentNo.6539113. 



Because the first featwe portion extractor 5 connects with the first input device 1, so the 
first €satUFe portion extractor 5 receives the first signal SI and extracts the first input vector VI 
fi-om the first signal SI . The method of extracting the first input vector VI is, for example. 





following: 



Please replace the last paragraph on page f with the following: 
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sampling the amplitude change of a certain frequency range, to obtain a plurality of featur e 
portion vector that belong to different frequency ranges. In the same way, the second featwe 
portion extractor 6 connects with the second input device 2, so the second leature portion 
extractor 6 receives the second signal S2 and extracts the second input vector V2 from the 
second signal S2, and generates a plurality of featur e portion vector V2. 



The first similarity estimator 7 connects with vocal database 30 and the first f e ature 
portion extractor 5. The second similarity estimator 8 connects with handwriting database 40 
and the second feature portion extractor 6. According to the vocal pattern of vocal database 30, 
the first similarity estimator 7 extracts possible alphanumeric symbol logopram array or 
alphanumeric symbol logogram from the vocal database 30 by the first signal S 1 . Owing to 



building up the vocal pattern, user can effectively bypass the valueless data by saving the search 
time of the first similarity estimator 7 toward the vocal database 30. 



In the same way, the second similarity estimator 8 extracts possible alphanumeric symbol 
logogram array or alphanumeric symbol logogram from the handwriting database 40 by the 
second signal S2. Besides, the first similarity estunator 7 and the second similarity estimator 8 
connect each other, therefore, for example, when the first similarity estimator 7 determines a 
alphanumeric symbol logogram array from vocal database 30 according to the vocal input of 
user, according to the handwriting input, the second similarity estimator 8 can also assign a 



Please replace the first paragraph on page ^ with the following: 




Please replace the second paragraph on page ^ with the following: 
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coincidental olphonumorio symbol logogram from the olphonum e rio symbol logogram array 
determined by the first similarity estimator 7. 



Finally, the candidate alphonumerio symbol logogram determined by the first similarity 
estimator 7 and the second similarity estimator 8 transmitted to the application program, such as 
Microsoft Word, and shown on display 50. Of course, except the first input device 1 and the 
second input device 2, the functions of the other devices are compiled by programming codes, 
executed by computer. The data for use is build in vocal database 30 and handwriting database 
40 in advance. 



with the following: 

Therefore, base on the above structure and as shown on Fig.2, the present invention of the 
recognition method integrating vocal and handwriting input is shown as step 21 and 22, first, 
receiving a first input. The first input device 1 is utilized to receive the vocal input and convert it 
to the first signal SI . For example, if user wants to input a word as Fig.5, he can do a vocal input 
by pronouncing [fon /] as the first input. The first input can be recognized by the first feature 
portion extractor 5 and the first similarity estimator 7, and then extract the corresponding data 
from the vocal database 30 to generate a alphanumeric symbol logogram array coinciding with 
the first input. The extracted olphonum e rio symbol loeoeram array in this example is shown as 
Fig.4, the candidate alphanumeric symbols lo gograms of the olphonumerio symbol loeoeram 
array are sorted according to the usage rate. 




Please replace the third paragraph on page>^ with the following: 
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Please replace the second complete paragraph on page^ with the following: 

{p^rj^ylrOi D^jring this time span, if the user utilizes the second input device 2 for inputting the 
featur e portion presenting the characteristic of Fig.5, then as step 24 shows, extracting one 
recognition character corresponding to the second input from the alphonum e rio symbol logogram 
array. In this embodiment, the inputted feature portion of the alphanum e ric symbol logogram 
represents the radical of the alphanum e ric symbol logogram . Therefore, as Fig.S shows, user 
may input the radical of the alphanum e ric symbol logogram (shown at left side as filled type). 

W "J^ybOt Please replace the final paragraph on page p and ending on page ifi with the following: 

After extracting the alphonum e rio symbol logogram array corresponding to the 
pronunciation [fon /] by the first similarity estimator 7, and then utilizing the pattern recognition 
technology of the second similarity estimator 8 to search the alphanumeric symbol logogram 
with similar shape or radical from above alphanumeric s ymbol logogram array. By this 
procedure, it is obvious to know that the alphanumeric symbol logogram of Fig. S with radical at 
the left side of Fig.S is the most coincidental alphanum e ric symbol logogram matching the 
limitation of the second input. As step 25 shows, the most coincidental alphanum e ric symbol 
logogram represented as Fig.S will be shown on display 50. Of course, for representing the 
handwriting f e atur e portion of alphanum e ric symbol logogram as Fig.S, user may only 
handwriting input a part of radical such as the left side filled shape shown on Fig.6, or only 
handwriting input a part of the alphanumeric symbol logogram distinguishing from the other 
candidate alphanumeric symbol logogram, in this way, the system can also process the pattern 
recognition and extract the object alphanum e ric symbol logogram . 
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\^-X^d pieasg replace the first complete paragra^)h on page ^^with the following: 

In the same way, another example is represented that the user wants to input a word as 
Fig.7. If user do a vocal input [fen \], then the system will generate a alphanum e ric symbol 
logogram array including candidate olphanumorio symbols logograms corresponding to the vocal 
input, and user only have to do a handwriting input such as the radical (shown at upper side as 
filled type) of the character of Fig.7, then as Fig.7 shows, the character of Fig.7 will be extracted 
from the alphonumorio symbol logogram array by pattern recognition technology. 

\J( '7y^oi Ples^e replace the second complete paragraph on page }6 with the following: 

The other example is, when the user wants to input a word as Fig.8, first, if user do a 
vocal input [pau \], then the candidate alphanum e ric symbols logograms will be sorted according 
to usage rate and listed. As Fig.8 shows, if user handwriting input a radical (shown at left side as 
filled type), then the olphanumorio symbol logogram of Fig.8 including the radical will be 
selected by the second similarity estimator 8. Of course, if user do a handwriting input such as 
the other different radical, then the different alphanum e ric symbol logogram including the 
different radical will be selected. From the above examples, it can be clearly understood that the 
present invention effectively utilizes both the vocal and handwriting characteristic of Chinese. It 
is convenient for user to do only vocal input and a part of handwriting input then can recognize 
and input the character. 

l/n//'7^}.y^% Please replace the last paragraph on page ify ending on page l/L with the following: 
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On the other hand, as step 26, 27 shows, if there is not the second input, then the present 
invention will be merely a vocal recognition apparatus, it will extract the most frequently utilized 
character accordmg to vocal input [fon /] as well as the usage rate. Of course, in this situation, 
the recognition rate will not be promoted, unless the input alphanumeric symbol logogram 
happens to be the most frequently utilized character. 



Besides, refer to Fig.3, the present invention can also be represented as step 201 203, if 
user does vocal input [fon / ], then the most frequently utilized candidate alphanimi e rio symbol 
lopopram (the alphanum e ric symbol logogram of Fig.5 without the left side radical part) will be 
shown on the display 50. If user finds that the input object is an alphanumeric symbol logogram 
as Fig.5 rather than the most frequently utilized candidate alphanum e ric symbol logogram, then 
user can process the second input (a radical shown at left side as filled type of Fig.5) in a 
predetermined time span. As step 204, 205 shows, the present invention will extract the 
alphanum e ric symbol logogram as Fig.5 from the alphanimieric symbol logogram array 
corresponding to the second input, and as step 206 shows, replace the most frequently utilized 



candidate alphanumeric symbol logogram by alphanumeric symbol logogram with a radical 
characteristic. 



?>3^6 Please replace the second complete paragraph on page ]/l with the following: 

On the basis of the characteristic of Chinese, even a plurality of alphanum e ric symbols 
logograms correspond to the same pronunciation, the discrimination between the alphanum e ric 
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symbols logograms is quite obvious, taking Chinese character on Fig.4 for example, the radical 
and handwriting style for each alphanum e ric symbol logogram is quite different. 



Therefore, by the complement between vocal input and handwriting input, user can easily 
and effectively promote the recognition rate by the combination of vocal input of an 
alphanumeric symbol loeoeram and radical part of handwriting input, rather than completely 
handwriting input each complex alphanum e ric symbol logogram . Therefore, the present 
invention makes the input and recognition more efficient. 




Please replace the third complete paragraph on page y 1 with the followmg: 
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